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Abstract 



£f) • We show that the conservation and the non-additivity of the information, together with 

> 

in 

the entangled quantum state offers an example of the information non-additivity. Neverthe- 



the additivity of the entropy make the entropy increase in an isolated system. The collapse of 



less, the later is also true in other fields, in which the interaction information is important. 
Examples are classical statistical mechanics, social statistics and financial processes. The 



second law of thermodynamics is thus proven in its most general form. It is exactly true, not 

only in quantum and classical physics but also in other processes, in which the information 

Oh, is conservative and non-additive. 

> 
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To understand the foundation of the second law of thermodynamics is a long standing prob- 
lem in physics. Text books tell uspj, the state of a macroscopic system with larger entropy is 
more probable. However, whether the system always goes from a less probable state to a more 
probable state is still an open question. The H-theorem of Boltzmann is a classical proof for 
definite approaching to equilibrium. It is based on a model of colliding classical particle system 
for the macroscopic matter, therefore is not general enough, even from the view point of the 
classical statistical physics. In 1948, Shannon[21 [3] discovered a powerful theory of information. 
It is applicable in analysis of all statistical processes, including statistical physics. Here we show 
that by use of its fundamental ideas, one can simply prove the second law of thermodynamics in 
its most general form. In quantum statistical mechanics, it is based on the state entanglement 
in time development and the state collapse in measurement, therefore is quite general. 

The time development of the density operator p(t) for an isolated system is governed by the 
von Neumann equation. Its solution is 

p(t) = U(t,t )p{t )U(to,t) , (1) 
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in which U(t,to) is the time displacement operator of the state from time to to time t. Defining 
the information 

X(t) = Tr\p(t)hxp(t)] (2) 

at time t, we see from ([1]) 

J(t) = Ti[U (t, t ) p(t ) In p(t )U (t , t)} 

= Tr[p{t ) In p(t )U (t , t)U(t, to)} =l(t ) , (3) 

because of U(to,t)U(t,to) = 1. It is the information conservation in quantum mechanics [4 . 

To measure the entropy of a system, one has to divide the system into macroscopically 
infinitesimal parts. The entropy of the ith part is defined to be Si = — k B Tr(pi Inpi), in which 
Pi is the reduced density operator of the part i. The entropy of the whole system is defined to 
be the sum 

S = Y J Si = -k B Yl Tr (^ ln Pi) ( 4 ) 

i i 

of the entropies of these parts, as an extensive thermodynamical variable should be. When one 
measures the entropy of the system at time to, he has destroyed the entanglement of the states 
of various parts of the system. The state and the density operator of the system are therefore 
factorized. Under this condition, the entropy of the system is 

S(t ) = -fcs J^Tr^CtQ) lnpiCto)] 

i 

= -k B Tr[p(to)lnp(to)] = -k B l(t ) . (5) 

For an isolated system, the information conservation ([3]) works. The information of the system 
at t > to is therefore 

I(t) = -S(t )/k B . (6) 

During the period from time to to t, the interaction between different parts of the system makes 
their states be entangled again. It means the states of different parts are correlated. If one 
measures the entropy of the system at time t, he has to measure the entropies of every part of 
the system, and therefore destroy this entanglement once more. This is the state collapse, and 
causes the loss of correlation information. Since the parts of the system are not isolated, their 
information is not conserved. It makes the entropy 

i 

at time t does not equal S(to) in general. By intuition we see, the sum of information of all 
parts of the system should not be more than the information of the system, since the correlation 
information of various parts is not included in the sum. It is 

Y^Tr\pi(t)hipi(t)]<X(t). (8) 

i 
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If this is true, we obtain 

S(t) > S(to) (9) 

from ([6])-([8]) for an isolated system. 

To prove the statement ©, let us remind you some mathematical inequalities. We also 
collect the proofs of these inequalities here, to make our description be self-contained, although 
their original forms may be found in text books [U \5\. By the way, in the following we understand 
that OlnO = lim^ (£ln£) = 0. 

Lemma 1. For any non- negative number x we have 

xlnx > x — 1 , (10) 

the equality holds when and only when x = 1. 

Proof: It may be verified by differentiation, that xlnx — (x — 1) as a continuous function of 
non-negative variable x has unique minimum at x = 1. The lemma is therefore proven. 
Lemma 2. For sets [wi] and [xi] of non-negative numbers with ^Pt% x i = 1) we have 

XiWi In x i' w i' < '^^XiWilnwi . (11) 

i V i 

Proof: The average w = XiWi is non-negative. For w > 0, by lemma 1 we see 

XiWi In Xi'Wii — x i w i m w i 
i V i 

E-Wi Wi s-^ _ Wi 

XiW— in — < — > XiW{— — 1) = , 
w w w 



(|lip is true. Since two sides of (jlip are continuous functions of non-negative variables [wi] and 
[xi], it is also true for the limit case w = 0. The lemma is therefore proven. 
Lemma 3. For sets [Wi] and [1^-] of non-negative numbers with 

i i j 

we have 

w- = J2 WiTi ^° fOTever yj> ( 13 ) 

i 

3 

and 

w j in w j < Yl Wi ln Wi • ( 15 ) 

Proof: (|13p and (|14p are obvious. By (|12j) and lemma 2 we see 

Y w > w 3 = E(eWWe^';J 

j j \ i / \ i' / 
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The lemma is therefore proven. 

Lemma 4. For positive numbers [Wij], Wi = Yl,j and Wj = J2i Wij, with £V Wij = 1, we 
have 

Y^Wi = l, 52W< = 1, (16) 

* j 

and 

^ Wy In > Wi In Wi + In VFj . (17) 

» 3 

The equality holds when and only when = WiWj for all ij, it is that the Wij may be 
factorized. 

Proof: (|16jl is obvious. By lemma 1 we see 

^ inJ^>J*k__i, (is) 



WiW'j WiW'j - WiW'j 

the equality holds when and only when Wij = WiWj. Multiplying two sides of (fT8]) by the 
positive number WiWj and summing up over ij, one obtains 

^2 w v lnW ij ~Y, WilnWi ~Yl w j lnW j - • 

ij i 3 

This is exactly ()17p . The lemma is therefore proven. 

Suppose [L] is a complete set of commutative dynamical variables of the system, with a 
complete orthonormal set of eigenstates [\n}]. The [L] representation of density operator p is a 
matrix with elements p nn i = (n\p\n'). If p itself is included in the set [L], the [L] representation 
of p is called natural. In a natural representation, the density matrix is diagonal: p n;H / = W n 5 n;n i, 
in which W n is the nth eigenvalue of p, denoting the probability of finding the system being in 
the state \n). The information ([2]) may be written in the form 

l = ^W n lnW n , (19) 

n 

with a set [W n ] of non-negative numbers. One may also consider the information about a 
specially chosen complete set of commutative dynamical variables [£/], with complete set of 
orthonormal eigenstates [\m)]. For an ensemble of the systems with the density operator p , the 
probability of finding the system in the state \m) is 

W' m = ^2(m\n)W n {n\m) . (20) 

n 

The definition of the information about the variables [V] is 

T [LI] =Y, W ^ W 'm- ( 21 ) 
in 

Since |(n|m)| 2 are non-negative, and ^nl( n l m )| 2 = SmK n l m )| 2 = ^> according to lemma 3 
and equation ([19]) we have 

< 1 . (22) 
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Now, let us divide the system into two parts a and b. Suppose [Li], with i = a or b, is a 
complete set of commutative dynamical variables of part i, \rii) is their rijth eigenstate, and [\rii)] 
is a complete set of states of part i. Therefore [|n a n&}] = [|wa)|^&)] is a complete orthonormal 
set of states of the system. In the [L a Lb] representation, The density operator of the system is 
a matrix, with elements 

Pn a n b ,n' a n' b = (ri a n b \p\ri a n b ) . (23) 

From (|2U|) we see the probability of finding part a in the state \n a ) and part b in the state \n ) 
is 

w n a n b = ^2(n a n b \n)W n (n\n a n b ) , (24) 
n 

with normalization 

E W nan b = 1 • (25) 
n a n b 

The information of dynamical variables [L a ,L b ] is 

l La ,L b = £ W nanb In W nanb < 1 . (26) 

n a ,n b 

The probability of finding part a in the state \n a ) and the probability of finding the part b in 
the state \n b ) are 

Wn =E^ and W n b = T. W ^- ( 2? ) 

respectively. In (|25M27p . it is understood that the summation is over those n a and n b only, for 
which W narib > 0. 

The density operator p a of part a is reduced from the density operator p of the system. In 
the representation [L a ], it is a matrix with elements 

(Pa)n a ,n' a = Pn a n b ,n' a n b = ^(n a n b \p\n' a n b ) , (28) 
n b n b 

and may be written in a compact form 

Pa = Tr b p . (29) 

The subscript b denotes that the trace is a sum of matrix elements diagonal with respect to 
quantum numbers of part b. Likewise, p b = Ti a p. Suppose pi is included in the set [Li], the 
probability of finding the part i in state |n«) is its eigenvalue W ni , and is expressed in (f2T|) . The 
information about part i is 

Ti = Tr Pi In Pi = E ^ In W ni . (30) 

From lemma 4 and equations (|26l27p we see 

Tr p a ln p a + Trp b lnp b < Trplnp . (31) 
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The equality holds when and only when the density operator of the system may be factorized 
into a direct product of density operators of its parts, it is when and only when its parts do not 
correlate with each other. We may further subdivide the parts and apply (|31f) to them again and 
again, the result is the statement (JSj) - As we showed before, this statement proves ([9]), which is 
the 

Theorem: The entropy of an isolated system if changes can only increase. 

It is exactly the second law of thermodynamics. This law is therefore finally proven. According 
to the relationship between the entropy and the probability of a macroscopic state [1] referred at 
the beginning of this paper, it in turn shows that an isolated macroscopic system always goes 
from the less probable state to the more probable state. 

The proof here is quite general. It looks like relying on the quantum mechanical effects of 
state entanglement and its collapse. However, it is still more general. It is an information theo- 
retical proof, relies only on the conservation ([3]) and the non-additivity (|3ip of the information. 
The extensive character Q (additivity) of the entropy is also important. Information conserva- 
tion is a character of dynamics. It is shared by quantum dynamics and classical dynamics, as 
well as some possible dynamics not yet have been discovered. The non-additivity of information 
is purely mathematical. It may be deduced from the general relations (|27p of the probabilities 
by use of mathematical inequalities stated before. State entanglement and its collapse is only a 
special way of their realization. They may be realized in classical mechanics or in some unknown 
mechanics as well. The second law of thermodynamics is therefore almost dynamics indepen- 
dent, except the requirement of information conservation. It may be still exactly true in the 
future, even though one day people find that the quantum mechanics is only approximate. It is 
also quite generally applicable, not only to thermodynamics but also to some other statistical 
sciences, if the information conservation is true for them. To consider its possible applications 
in the social and financial sciences is interesting. 

From the proof we learn that the entropy of an isolated system increases only because 
one loses the correlation information between different parts of the system. It emphasizes the 
importance of the correlation information in a complete statistical science. 

This work is supported by the National Nature Science Foundation of China with Grant 
number 10305001. 
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